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;■■ .. , TflE [HE rO'PEIEATORY D^UCATim STUDY; • 

EVALUATIOM FOR reCISiai-mKIf'iG PURPOSES ■ , 

He are hlERE TODAY TO DISCUSS NIE's STUDY OF COf^PENSATORY EDUCATION, 
AMD MORE SPECIFICALLY OF TiTLE I OF THE ELEMENTARY /mND SECONDARY- 

Education Act, as^a response to Congressional evaluation needs. 

Before the ot>ier mb^'bers of the panel describe individual studies 

V/HICH form a part OF THE OVERALL EVALLJATION. I Wm TO SPEND A FEW 
minutes discussing THE RATIONALE FOR THE EVALUATION APPROACH WE ADOPTED. 
I WANT TO DO SO BECAUSE AL"mOUGH THE QUESTIONS WE ARE ASKING ARE IN 
MANY 'WAYS F/!/lILIAJ^, THE WAY IN WHIChI WE ;\RE TRYING TO ANSWER ThlE QUESTIONS 
IS NOT, . 

As A BACKGROUND TO THIS DISCUSSION, I WANT TO FIRST TOUCH BRIEFLY 
UPON THE ORIGINS OF TlTLE' I "aND CONGRESSIONAL INTEREST IN EVALUATION., 

Then I will turn to sc^^ prior efforts to assess the effectiveness 
OF Title L and Con'gressiomal rea.ction to those efforts. 

Finally, I will tell you of our ov^i attempt to buiud an evaluation 
strategy incorporating ihe lessons we learned from, those Who WENT before 
us. , , 

ORIGINS OF TITLE I OF ESEA. 

. Looking first at the origins of the Elei^.entary atjd Secondary 

Education Act, most of you Kj'ow jm several political, social, and 

EcoNaiic forces, co>yce-5,ced in 1855 to create m M'^im variety of new- •' 
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PRCX3R/V-1S Ai;-rD AT CORRECTING SEVERAL EaiESTIC ILLS. ' 

One result of that coalition was the/enactt-ient of the first wjor 

1 

Federal prog.wi providing assistance for bucATioNAL efforts at the 

elementary AMD SECONDARY LEVEL. THE ElB-iENTARY AND SECONDARY EdUCATIOM 

Act of 1965 , The history of Thv\T event \-y\s beei-i m-tly docH'Ieisited 

ELSEWHERE. SO I WILL TOUCH SIMPLY UPON A FEW OF ITS HIGhlLIGHTS .1 

After the m world m<j one of the great tensions in Americatj 

POLITICS WAS EETIVEEN THE PROGRESSIVES IN BOTH MAJOR POLITICAL PARTIES. 

WHO SUPPORTED FfXERAL AID TO EDiUCATION AS A ■''gCOD THING". AND THE OPPONENTS 

OF Federal education aid. v;ho feared Federal domination of the schools. 
• Supporters of Federal aid pushed several serious attempts following 

THE second world WAR TO ENACT A FEDERAL PROG^RAT'l OF GENERAL AID TO 
education. THAT I,S. AID ThAT COULD ..BE, USED AT LOCAL DISCRETION FOR ANrTHING 
FRQM EDUCAT^O^V\L jpROGWi?. TO T£;\CHERS' SALA.RIES^ TO CAPITAL CCrJSTRUCTION. 

But OPPOSITION wAs so severe im it appeared doubtful as late as 1963 ti-iat 

1 

ANY substantial FeDERAL ASSIST^I-iCE FOR SCHOOLS WOULD BE FORTHCailKG FOR AT 
LEAST A DECADE, 

OriE OF THE mJOR FORCES OVERCOMING THIS OPPOSITION WAS. COTPOSED OF 
ADVOCATES OF THE VIEW THAT SOCIETT HAD SPECIAL OBLIGATIONS TOWARD THE MOST 
VULNERABLE OF ITS CITIZENS. THE POOR, 

Several individuals, including FlicHy\EL Harrington, provided vivid 

DETAIL ON THE INCIDENCE OF POVER"Y IN ThiE WELF/\RE STATE A^JD PP- - TENSE 

DEBATE ABOUT THE appropriate public RESPONSE TO THIS PARADOX, "i, X'E 

THE PUBLIC AM) ITS OFFICIALS A^A^RE. IN HaRRINGTON's WORDS. THAT: 

. . .TENS OF MILLIONS OF AMERICAfvIS ARE. AT THIS VERY MOMENT. 
MAIMED IN BODY A^^jD SPIRIT. EXISTING AT LEVELS BENEATH THOSE 
NECESSARY FOR mm DECENCY. 
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OiE OF THE Da'llNWJT THB-iES OF TWSE LJNCERf-lED WITH POVERTY BECA^'E THE 
DEBILITATING EFi-ECT THAT POVERT/ HAD ON THE LIVES OF CHILDREN. In 1968. Gu\ZER 
AI^D CreEDON EDITED A SERIES OF ARTICLES A^^D ESSAYS DEVOTED TO THE SUBJECT OF 
IMPOVERISHED CHILDREN.-^ i'kNY OF THE ARTICLES PRECEDED ENACTr-'iEi^JT OF cSB-u AND. 
IN FACT. SEVERAL OF THEf'l WfIRE FROM THE 195C's. 

I WILL QUOTE EXTENSIVELY FRCT'i THE DISCUSSION OF THESE Tl-,'0 AUTHORS BECAUSE. 
IT SEEMS TO ME. THEIR VIEWS ARE AN EXCELLENT OUTLINE OF THE CONCERNS OF 
INFOPxf-'iED POLICYMAKERS IN THE 19C0's. 

"The DISADVANTAGED CHILD/' THEY' WROTE IS: 

Exposed to material. . .deprivations which generate a feeling 
OF powerlessness . Even though poor parents fay often have 

HIGH aspirations FOR THEIR CHILDREN. CONTRARY TO POPUU\R 
belief, they also OFTEN BELIEVE T^T THEIR CHILDREN HAVE 
LITTLE CmNCE OF SUCCESS. 

ScHiX)LIN6^HEY, POINTED OUT. APPEARED IRRELEVATiT TO THE POOR. Cw THE ONE 

HAND. MAfJY POOR CHILDREN DROPPED OUT OF SCHOOL BECAUSE OF FINAK'CIAL CRISES IN 

THE HO^'iE. THE OTHER: 

If the poor child remains in school, he is likely to have THE 
LEAST EXPERIENCED TEACHERS. l^kjY OF THE LATTER HAVE LITTLE HOPE 
FOR THEIR STUDENTS. AND IN MANY CASES. ARE THEMSELVES DEMORALIZED 
BY THE, COrOIT IONS UNDER WHICH THEY MUST JBfiLH. FoR THE NeGRO. THE 

imexicam-/V,eric^^'. ai^d the Puerto Rican child, there is thf additional 
onus of race prejudice in and out of the classroom. 

.. Lyndon Johnson, by a stroke of political genius, melded these and other 

GROUPS interested IN CHILDREN AiD EDUCATION INTO A FORCE STRONG ENOUGH TO OVER- 
COME THE FEARS OF EeDE.RAL AID TO EDUCATION AND ENACT. THE ELEMENTARY Ai\C SECONDARY 

Education Act. 

ESEA HAD SEVERAL TITLES. OR PARTS, It PROVIDED ASSISTANCE FOR PROGRAMS TO 
IMPROVE LIBRARIES. TO FUND IMAGINATIVE EDUCATIONAL PROJECTS. TO STRENGTHEN 
STATE DEPARTOENTS OF EDUCATION. AND TO FOSTER EDUCATIONAL RESEARCii. 

But THE URGEST Pmi OF THE ORIGINAL LEGISLATION. AND THE ONLY AREA. 
WITH WHICH WE ARE CONCERNED. WAS TiTLE i WHICH ' NOW PROVIDES OVER $2-BILLI0N 



Ar-JMUALLY FOR EDUCATION. ThE F^DS MUST BE USED IN SCHOOL DISTRICTS WITH 
CONCENTRATIONS OF POOR CHILJ:REN IN ORDER TO IMPROVE THE EDUCATIONAL PROGRAMS 
OFFERED TO A LIMITED NU^'iBER. OF CHILDREN ~ "EDUCATIONALLY DISADVAT^TAGED" 
CHIU^REN. THAT IS, CHILDREN hWO ARE NOT DOING WELL IN SCHOOL WHETHER OR NOT 
•TTiEY ARE FROM LOW-INCa-'E FA/-1ILIES. 

In brief, the PR0GR^-1 was DEVtLOPED OUT OF A HWHE CONCERN FOR PRECI^SELY 
THE CHILJ3REN- IN THE ViORST ECONOMIC AND EDUCATIONAL CIRCLMSTANCES DESCRIBED ' 
BY GUZER AND CrEEDON. y ' ■ 

mmmx of ti uf i 

Included in Title I was a reouikemeijt that was unique at the time; a 
reguirement that progpj\ms funded with Title I be evaluated at-inually at the 
local, state. Am Federal levels. . , 

The. evaluation requirements were written into the Act at the insistence 
of Senator Robert Kennedy, His motivation was two-fold; First, a desire to 
insure that Title I funds were expended upon educationally disadvai^jtaged 
children in poor areas Ai\d not spent as general aid in the districts 
receiving fui>®s. second, a hope that enforcing accountability upon school 
districts w0ulj3 result in enhanced achieve^"ent of title i stldents. 
• ■ fillbrey'mclaughlin has d€ne at-i d'.cellent job 01= describing the history 

of evaluation efforts in title i .^'^ [ier account . traces the tension eehveen 
the several schools of tholghft about the appropriate role" of evaluation in a 
large progpjim such as this ~ th.at is to say disagreements about whether 

EVALUATION ShlOUli SERVE AS A PRCGR/V^I f-WJAGEM,ErjT DEVICE/ OR AS A TOOL TO INSURE 
. THE PROGRAT'l WAS IMPLEMENTED AS INTENDED BY THE LEGISUVTION,. OR AS AN INSTTRU" . 
MENT FOR BASIC RESEARCH ON THE ACHIEVEMENT GROWN OF DISADVANTAGED STUDENTS. 
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For tme "iOst ppm, evaluations of Title I have focused on the achieve- 
ment OF PARTICIPATING STUDENTS, HaD THOSE EVALUATIONS BEEN ABLE TO 
DEMONSTRATE A CONSISTENT REU\TI0NSHIP BET\€EN THE PRESENCE OF TiTLE I FLiNDS 
. IN SCHOOL DISTRICTS AND INCREASED RATES OF READING ACHIEVEMENT, THE SUP.SEQUENT 
DISPUTES ;30Lrr the EFFECTIVEfJESS OF TiTLE I V,'OULD NEVER HAVE ARISEN, HoWEVER. 
EFFORTS TO DET^'ISTRATE T^iAT RELATIONSHIP HAVE SELDCf^ BEEN SUCCESSFUL. 

Initially, I-IB'I officials thought that' local evaluations couud ee 

AGGREGATED AT WE STATE LEVEL, AK'D THAT STATE EVALUATIONS COULD BE 
AGGREGATED AT THE NATIONAL LEVEL IN OPj:€R TO DEf'lGNSTRATE THAT TiTLE I HELPED 
. IMPROVE STUDENT ACHIEVEMENT mi) HENCE DESERVED SUPPORT, 

This approach ms unproductive. l\m school districts did not collect 

ACHIEVEMENT DATA IN USEABLE FORM, AND, IN FACT, ' ONE YEAR ONLY 1^ STATES 
provided data that COUUD be aggregated UNlFORf-lLY,^ As A RESULT,. LEGISLATORS 

mid the public got the impression that title i could not be shown to l^ve 
ak effect upon the achievement of participating children, 
p\eseami turned in other directions, 

One was atj, effort to collect uniform data through national surveys. 

KaTFRYN HeCHT has pointed out that these national surveys WERE' DESIGNED TO 
avoid OF THE PROELB'IS OF THE EARLIER EVALUATION EFFORTS, AI^JH INCLUDED 

pu\NS FOR Pupil Centered Instrlf.ents at® project descriptors to provide 
detailed infopvf-iation on students served and the probraz-is serving themp 

But the design v-as never fully implb-'Iented. As a consequence, "accurate 

AND detailed descriptions OF PROGRAJ-iS WERE NOT POSSIBLE, NOR COULD THEY EE 
■rEUTFX) to pupil ACHIEVEI-IENT,"' f'OREOVER, '''PROGR/SM PARTICIPATION AND ITS 
EFFECTIVENESS WERE STILL NOT BEING MEASURED." 

I _ . The result: Title I couu: not be db-ionstrated to have an effect on 

' student ACHIEVB-1ENT. 
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A DIFFERENT EFFORT WAS INITIATFJ) TO IDENTIFY SEVERAL SUCCESSFUL f-lODELS " 
OF COMPENSATORY EDUC/\TION WHICH COULD EE REPLICATED ELSEWHERE, 

But WHEN. A FEV^ YEARS U\TER. THE Ml CONTRACTOR RETURNED TO THESE 
MODELS. flOST OF THE SL'-^^SSFUL PROGRAMS WERE NO LONGER FUNCTIONING FOR 
ONE REASON OR ANOTHER,'/ 

By NOW MY THET'iE SHOUUI' EE FAMILIAR: RESE/\RC1!ERS ANXIOUSLY SEA,RCHIN6 
FOR EVIDENCE TO DEMONSTRATE .-iAT TiTLE I WAS' EFFECTIVE IN RAISING ACHIEVE- 
MENT WERE ThV/ARTED BY THE INTRINSIC DIFFICULTY OF THE RESE^CH PROBLEfi. ThEY 
BEGAN HOPING TO JUSTIFY THE PROGRAM 's EXISTENCE BY SHOWING THAT IT RAISED 
students' ACHIEVEMENT, ThEIR RESULTS WERE INCONCLUSIVE. BUT DESPITE RESEARCHERS' 
CAUTIONS A50UT Htt-/ THEIR RESULTS SHOULD EE INTERPRETED. THE PRESS CONSISTENTLY 
REPORTED THAT "COMPENSATORY PROGRAMS FAIL." OR "TiTLE I DOES NOT WORk" OR 
ANOTHER PIT>IY SU^'MARY THAT MET Tf^E AVAILABLE SPACE, 

CONGRESS IOrV\|JAC]M 

The REACTia^ of Congressional CG^^'1ITTEES to these evaluati on ^ results 

WAS PERHAPS PREDICTABLE: EXTREME DISSATISFACTION. 

Clearly, if the evaluatiqis had found that Title I money led to 

SPECTACUU^iR increases IN STL'DENTS' READING ACHIEVEMENT. CONGRESS W0ULJ3 HAVE 
NOT HAVE been' UNHAPPY, BuT CONGRESSIONAL EXPERTS ON EDUCATION V/HO SUPPORTED 

THE Title I concept were confronted with the fact that Title -I could not be 

SHOWN TO raise THE READING ACH I EVE! 'lENT LEVEL OF THE AVERAGE TiTLE I STLCENT 
. IN ThlE AVERAGE SCHOOL DISTRICT, tm THIS EVIDENCE WAS BEING INTERPRETED 
BY RESEARCHERS Af^D THE PRESS AS PROVING THAT TiTLE I DID NOT WORK. AaND. PERHAPS, 
COULD NOT WORK. 

f. 

Congressional experts were not prepared' to accept these evaluations as 
valid for several reasons, first. beca>use the evaluations focused lipon one 
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OUTCaC TO Ti'£ EXCLUSION OF OTHERS. SECOND. BECAUSE CoNGRESSIIEN SENSED THAT 

Title I in operation was a cCT'Iplicated PROGR/y^'i whose effects on chi.ldren and 

ON the educational system C0UU3 NOT BE NEATLY SU^^MARIZED IN SIMPLE ACCOUNTS 
OF STUDENT READING ACHIEVEMENT GAINS. AND THIRDLY, BECAUSE THE EVALUATIONS 

SENT TO Capitol Hill provided very little useful infowwion v;hich tthey 

•COULD use to IMPROVE THE PROGRAM. 

Let me say a word about each of these conceri^s . 
First, prior evaluations typically focused upon onepossible outcome 
OF Title I prograT'IS; the effect on children's reading and mathematics 

ACHIEVEI-IEKr. ,. 

Although student ACHiEVEf'iENT was clearly an impohtant purpo^^ of jhe 
statute. Congress had o'-her goals in mind, as well, in estaelihsing T>iE 
Title I prograt-i. 

This :s not a startling revelation new to us ~ as long ago as 1970. 

David Cohen was saying the sm-\e thing.^ Fr. Cohen said,; 

"It is. . .difficult to conclude that improving schools . 
production of poor children s achievei^ent was the 

LEGISU\TION S MAJOR PURPOSE, ThE LEGISUTIVE INTENT 
EMBRACED mNY OTHER ELEf-lENTS: IMPROVING EDUCATIONAL 
SERVICES IN SCHOOL DISTRICTS WITH MANY POOR CHILJ3REN. 
PROVIDING FISCAL RELIEF FOR THE CENTRAL CITIES AMD 
PAROCHIAL SCHOOLS. REDUCING DISCONTENT AND CONFLICT 
ABOUT RACE AND POVERTY. AMD ESTABLISHING Th'E PRINCIPAL 
• OF FEDERAL RESPONSIBILITY FOR LOCAL SCHOOL PROELEf'lS. 
I HE FACT ™t THESE WERE B'BODIED IN A SINGLE PIECE 
OF LEGISLATION CONTRIBUTED HEAVILY TO ITS PASSAGE. BUT 
IT ALSO MEANT WAT THE RESULTING PROGRAM WAS NOT SINGLE- 
PURPOSE OR HQMOGFNbOUS. IF ^NY SUPPOSITION IS IN ORDER. 
IT IS PRECISELY THE OPPOSITE'.' 

And. HE ADDED:" 

I 

"The main point.,. is that the purposes of the legislation 
■• were much more complex; most of them could be satisfied 

without ANY EVIDENCE ABOUT children's ACHIEVEMENT. •' 
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Second. Congress appeared convinced that the complexity of prograt-is 
funded under fltle i did not readily lend thekiselves to suf«mry measures of 

student ACHIEVEMENT. 

The 197^ House Report, for example/ rejected the criterion for 

EFFECTIVENESS USED IN SEVERAL TiTLE I EVALUATIONS,^ ThE RePORT STATED: 

"Regretfully, there are few evaluation reports which 
cain show scientifically the success of title i on a 
national leveu but thwt failure is not so much a 
failure of the prograt'i as it is a failure to under- 
stand the nature of the program. . . 

Title I provides direct aid to local school districts 

'TO USE AS THEY SEE FIT TO IMPROVE TTIE EDUCATION OF 
EDUCATIONALLY DEPRIVED CHILJ3REN. i^'iANY SCHOOL DISTRICTS. . . 
HAVE DECIDED THAT IT IS MORE IMPORTANT TO USE SUBSTA^J- . 
TIAL /^MOUNTS, OF MONEY TO MEET THE HEALTH=AND NUTRITIONAL 
NEEDS OF THEIR STUDENTS THAN TO CONCENTRATE SOLELY ON 
REM.EDIAL READING AND f-IATHEMAT ICS. THEREFORE, TO JUDGE 
THOSE PROGRAMS ACCORDING TO THE SOLE CRITERION OF 
READING ACHIEVEMENT IS AN INVALID EVALUATION OF THEIR 
EFFECTIVENESS. 

A 1971 Urban Institute discussion of evaluation aptly su^'MARIZES the 

DIVERSITY OF PROJECTS FUNDED WITH TiTLE I- : 

At THE LOCAL PROJECT LEVEL, WHERE ALL EVALUATIONS MUST 

START, Title I funds can be used to finance a broad 

RANGE OF activities FROM PRESCHOOL THROUGH HIGH SCHOOL. 

Individual projects may differ in AmosT every dimension. 
Levels of funding vary from a few dollars to several 

hundred dollars per CHILJ3 ~ BUT THE TiTLE I EXPENDITURES 
ARE ORDINARILY REU\TIVELY MERGER Ca-'iPARED TO REGULAR 
EXPENDITURES FRa-1 STATE AMD LOCAL FUNDS, ThESE ARE BUT 
A FEW OF THE PROBLEMS \'/HICH CONFRONT ThlOSE WHO ATTE/mPT TO 
EVALUATE TiTLE I PROJECTS. 

As IF TO CONFIRM CONGRESSIONAL SUSPICIONS OF THE VALIDITY. OF 

EVALUATIONS BASED SOLELY ON ACHIEVEf^ENT GAINS, A 1969 REPORT ON TiTLE I 

IN 28 DISTRICTS found' THAT FUr^S WERE NOT BEING SPENT ON THE MAJORITY OF 

ELIGIBLE CHILDREN, \€RE NOT. BEING CONCENTT^ATHD SUFFlCxENTLY, ATJD WERE 

PURCHASING EQUIPMENT ATID SUPPLIES AND NOT EDUCATIONAL SERVICES. ThE 
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report was prep-^jred by the children's defense fmd and the naacp.-^ 

Predictably, the results of this report reinforced the public 
consciousness that title i failed. but concerned congressmen were wre likely 
. . to concll£)e iwkl earlier evaluations were worthless because they measured 

OUTCQMES OF SERVICES THAT WERE NOT BEING DELIVERED,- In OTHER WORDS, OTHER 
EVALUATIONS SEB-iED TO IMPLY TH^T COMPENSATORY EDUCATION DID NOT AT© PERHAPS 
WOULD NOT WORK. ThE 1969 REPORT IMPLIED THAT COMPENSATORY PROGR/^MS WERE NOT 
IMPLH1ENTED AS INTENDED AND HENCE IT WAS THOUGKT VERY USEFUL FOR CONGRESSIONAL 

PURPOSES. Like Christianity, to abuse Show's faj^ious aphorism/ Title I had 

NOT been TRIELs 

Which brings me to my final point, n/v-iely that the -ormation presented 

IN prior evaluations provided little helpful INFORf-IATION FOR CONGRESSIONAL 
• DECISION-MAKING PURPOSES, ' 

The Title I program, to sLr-n/\RizE my earlier cca'ments, was part of a 
CQ'iPLEX Federal response to a diverse set of political, social, economic, 

EDUCATIOmL AI^D PUBLIC POLICY PROBLEMS, It INCLUDED A CORRECTIVE MECmNiSM " 
EVALUATION " SO THAT ADJUSTT^.ENTS COUUD EE MADE AS THE PROGRAf^ DEVELOPED. 

Bur THE EVALUATIONS FUNDED AS A RESULT OF THIS CORRECTIVE MECHAT^IISI^ HAVE 

I 

NOT MET Congressional needs, for at least tv\'o reasons. 

• They have focused upon only one of the concerns that prompted enactt-ient • 

/: OF the PRQfiRm, N/WELY THE EFFECTS" OF INSTRUCTIOriAL SERVICES, AND WITHIN THAT 
area principally upon changes IN STUDENT ACHIEVB'IENT, 

And, SECONDLY, THEIR RESULTS' HAVE BEEN INTERPRETED IN SUCH A WAY AS TO 
ANSWER THE QUESTION OF WHETHER OR NOT TiTLE I SHOULD BE CONTINUED, AND NOT 
HOW IT MIGHT BE IMPROVED, ' '• 

11 . 
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These factors lead r"£ to thE' conclusion that the evaluation process has 
• • not been neutral and. in fact, ms hurt the Title I effort in at least one 

IMPORTAr^T respect: the OUrCOf'lES that researchers cm MEASURE C0N\'ENIENTLY. 

namely. achievef€nt. have come to be perceived as the sole purpose of the 
program. 

as a result. evalua.ions designfjd with the best of intentioms to help 

IMPROVE THE PROGRAM WERE. IN TROTH. BIASED AGAINST IT IN THAT THEY B'BARASSED 
ITS ADVOCATES AND SUPPORTED THOSE VW OPPOSED IT. 

"E^■lBARASSp" MAY APPE.AR TO EE A PECULIAR TEm IN THIS CONTEXT; NEVERTHELESS 
IT APPEARS' APPROPRIATE. It IS APPROPRIATE BECAUSE EVALUATION UNFAIRLY FORCED 

Title I advocates to defend the PROGRAf^i as though its sole purpose was the 
enhancef-'ient of student achievb-ient. congress. as cohen pointed out. clearly 
had other purposes in mind as well. afjd these purposes were slighted ey the 
attempt to concentrate solely on achievef'lent. 

Tore to the point, early evaluations attempted to say something about 

■ achievement OUTCOflES WITHOUT DOCUMENTING THE EXISTENCE OF SPECIAL SERVICES 
or. IN FACT. THE PARTICIPATION OF THE STUDENTS BEING ASSESSED. EvEN IF ■ 

Congress were to agree that increasing student achievbient was jhe sole 
PURPOSE OF Title I. evaluations which ignore the realities of how such a 

PROGRAr-1 IS IMPLEfWED RUN THE RISK OF SERIOUSLY MISREPRESENTir!? THE 
potential contributions to THAT GOAL OF ADEQUATELY FUNDED AHD WELL MAT^AGED 
" , EDUCATIONAL SERVICES. 

,. In spite of the researchers' CALTTIONS regarding the MEANING OF THE RESULTS 
OF ACHlEVEfCNT BASED EVALUATIOf'JS OF TiTLE I. r^AMY PEOPLE CONCLUDED FRQM TriE' 
RESULTS THAT COMPENSATORY EDUCATION DID NOT WORK. OTHERS WENT FURTHER AND 
• , DECIDED THAT COMPENSATORY EDUCATION COULD NOT WORK. 
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This is not to say that the history of Title I evaluation" is not 

UNDER STATEABLE GIVEN THE INITIAL OPTIMISM ABOUT WHAT IT MIGHT EE ABLE TO 
ACCWPLISH. 

It is UNDERSTANDABLE. ALSO. THAT SOCIAL SCIENTISTS WOID 
A^"aIGUI.TY IN FAVOR OF SINGLE EASILY-MEASLKED OEvJECTIVF THE 
MOST CONVENIENT 1$ STUDENT ACHIEVEI^IENT GROl-,TH. 

HaVEVER. LEGISUTORS CAN LIVE QUITE Ca-IFORTABLY WITH A^'BIGUITY OF 
PURPOSESr To ENACT PROGR/^-IS LIKE TiTLE L LEGISLATORS MUST BUILD COALITIONS 
■ OF DIVERSE GROUPS AfjD INTERESTS; SUCH COALITIONS ARE POSSIBLE ONLY IF -THE 
program's PURPOSES ARE DIVERSE AW IF CONTROVERSIAL QUESTIONS APE RESOLVED 

ambiguously. 

The task of the evaluator, faced with the ambiguity of legisu\tion. is 

TO LIVE with the FACT THAT PROGRAMS HAVE DIVERSE OBJECTIVES. AND NOT AS HAS 

been the case in the past. to force-fit a complex problem into ati over- 
simplified analytical model. 

Those of us in Government and the private sector have. learned a great 
DEAL from Title I's evaluation history. Our own work reflects" our under- 
standing OF the need to doclment the nature of the program in operation in terms 

OF THh^ services PROVIDED AND THE PARTICIPATION OF' STUDENTS. The TV,'0 MOST RECENT 
studies FUNDED BY THE U. S. OFFICE OF BdUCATION'S OfFICE OF PlANNINKB. BUDGETING. 

AND Evaluation are based on similar logic; the tivo studies are an evaluation of 

READING OUTCOMES IN TiTLE I PROGRAMS. AND AN EVALUATION OF THE SUSTAINING EFFECTS 

■ OF Title I. 

To AVOID the BIAS INVOLVED IN FOCUSING EVALUATION ON ONLY ONE ASPECT OF 
A PROGRAM'!. RESEARCHERS MUST FIRST CONSIDER V.HAT TiTLE I OR OTHER COMPENSA ORY 
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EDUCATION PROGFV-IS ARR IN PRACTICE; ThlAT IS. HOW FUNDS' ARE DISTRIBUTED. 
PROGRAMS MATJAGED. AND STUDENTS AND SERVICES SELECTED. WiTH THIS INFORM/i.TIC'J. 
IT IS POSSIBLE TO IDENTIFY THE RAT^GE OF OUTCOM::S THAT TiTLE I IS BEING 
IMPLEf-lErJTED TO PRODUCE. AND THUS TO PU^ EVALUATIONS THAT GIVE A BALANCED 
OVERALL PICTURE OF PROGRAf'l EFFECTIVEMESS . 

NIF FVAimTTON 

as a result of congressional dissatisfaction with prior evaluations, 
arm as a result of congressional interest in the possible consequences of 
organizing title i differently. section 821 of the education .^lendments of . 
1974 requested nie to study compensatory education. 
We were asked to; 

ex/imine the fundamental purposes and effectiveness of 
compensatory education programs 

° Analyze the ways of identifying chiudren in greatest 
need of compensatory education 



° Consider altermative viays of meeting 1;hes£ children's needs 
° Consider w.e feasibility, costs, and cOnseouencps of 

alternative means of distributing Federal compensatory 

education funds. | 

In A WORD. THIS mmiE. put us in the POSITION bF BEIKG^A^CONTRACTOR. 

WITH Congress as our sole client. We \nhre -^'tq submit a proposal^-^^ 

TO Congress for approval; funds for the si -ecially set aside by 

Congress; and our reports go directly to Congress, without clearance or 

FORMAL review BY ANY OTHER AGENCY OF THE GOVERNMENT. 

Clearly. Congressional needs for informiAtion are PARAMomi ai© drt'e the 
research. mot olr needs or our preferences. 

Essentially Section 821 can be conceived of as too MiAJor requests froi . 
Congress. 

The first requires us to assess the effectiveness of compensatory 

education programs in meeting their FUNDAf-lENTAL PURPOSES. ■ 

The second cha!,3es us with an examination of alternative methods by 
vmich the effectiveness of cof-ipensatory education might be improved. 

The Interim Report vmcH we submitted to Congres: ust.Decb-ber defined 

THE FUND/V-1ENTAL PURPOSES OF TiTLE I Af^lD HOW WE PROPOSE TO EXAT-IINE ITIE 
EFFECTIVENESS OF THE PROGRAM IN ATTAINING THOSE PURPOSES AND THE CONSEQUENCES 

of possible changes. 

Others here will discuss how we are looking at each of the purposes of 
Title I. My purpose is to expuin \'mj those purposes are. and to lay our the 

GENERAL STRATEGY OF RESEARCH BY WHICH WE EXTV-IINE THEM. 



FUmfNTAI. PDRPaSRS 

To EXNAim THE FUND/aMENTAL PURPOSES OF CCMPENSATORY EDUCATION 
PROGRAMS. 0,\E MUST DISTINGUISH THE BROAD PHILOSOPHICAL CONCERNS T,4AT 
FAY HAVE MOTIVATED THE PRC^iPJi^•^S ORIGINATORS FROM THE MORE CONCRETE 
OPERATIOf^AL PURPOSES T^T ARE BUILT INT' PROGR/^. 

ThF RIGINATORS of SUCH :ATI0N programs as Ti l u" I 

m f-lAVE HAD IN MIND SOME VERY GENERAL PURPOSES. INCLUDING HELPII^G TO 
ELIMINATE P0VER17; CONTRIBUTING TO ThIE REDISTRIBUTION OF WEALIU A\'D OPPOR- 
TUNmj REFORMING EDUCATIOfj!^ AND SYI^1B0LIZII\K3 SOCIETY'S CQ'-MITTvlENT TO 
HELPING THE DISADVANTAGED. ALTHOUGH IT IS POSSIBLE TO SPECULATE ABOUT 
WHAT IHE BASIC O^ECTIVES MIGHT BE. THE DEBATES. STATUTES. AND, OFFICIAL 
LEGISLATIVE REPORTS THAT ESTABLISHED THE PROGRAM CONTAIN A SPECIFIC SL , 
OF FUivDAMENT'^L PURPOSES. . '■ 

FlN,A^jCIAI A3^S I STANCE IS CL ;LY ONE OF Tr^-., ~rZ ElEFiENTARY AND- 

^-cohmRY Education Act of 1965 . FORl^v\LLY entitl^^ "an Act to stofng- 
/\nd improve educational QUALir D educational opportunities in the Matj s 

ELE^-IENTARY A^JD SECONDARY SCHOOLS/' It THUS WAS A CORNLRSl-QNL CF AN' EMERGING 

Federal interest in equality cf .educational oppo^rtunity. / Enactment of the 
ESEA WAS the culmination of decades of conflict concerning whether the 
Federal Government should provide aid to ELEf-iENTARv aic secondpjry schools and 
v,wether stl'dents in private --o^ls shoulj) benefit. The Act establishet the 
-E'.i:al intc-:;est in elb-:l:t,: ^^econdary educati n m clearly included 
:r-/ATE school students a:ong ^ beneficiaries. 

Section 101 of Title I. f ;tled "Declaration c,-- Policy." is a statement 

OF the PROGR/VVS FUNDING OBJECTIVES. SECTION 101 STATES : 

, In RECOGNITION OF THE SPECIAL EDUCATIONAL NEEDS OF CHILDREN OF LOVMNCOME 
FAMILIES. AIsID THE IMPACT TriAT CONCENTRATIONS OF LOW" INCOME FAfllLIES 

HAVE CN THE ABILITY OF LOCAL EDUCATIONAL AGENCIES TO. SUPPORT ADEQUATE 1 



EDUCATIONAL PROG.WjSv THE CONGRESS HEREBY DECLARES IT TO EE 
THE POLICY OF THE LnITED StATES TO PROVIDE FII^JAMCIAL ASSISTANCE 
...TO LOCAL EDUCATIONAL AGENCIES SERVING AREAS WITH CGNCENTRA- 
TIONS OF CHILDREN FRai LOW- INCOME F/^WILIES. . . 

The 1965 House report AccofiPANYiNG this legislation referred to the 

VIEW OF THE Ca--^1ITTEE ON EDUCATION AND UeOR THAT "aID TO THE ECONOf'l I CALLY 
DISADVANTAGED CHILD REPRESENTS^THE BASIC APPROACH TO WIDESPREAD EDUCATIONAL 
IMPROVEMENT IN THIS COUNTRY.'" TiTLE L THE I - .EST OF THE ISFA PROGR/V^S. 
THEREFORE. WAS INTENDED TO BE THE PRINCIPAL rEDERAL METHOD FOR IMPROVING EDU- 
CATIONAL GUALIPt' AND EDLK:ATI0.\'AL OPPORTUNITIES FOR CHILDREN IN SCHOOL 
DISTRICTS SERVING AREAS WITH URGE r^^JMBERS OF LOW-INCCME CHILJDREN. 

The House of Representative's ~^port accq^ipanying the 197^1 Education ' 

/VlENDMENTS REITERATED ThIAT "a PRIN / T : . /ATION. . .^;AS THE DESIRE TO DISTRI~ ' 
BUTE SUBSTAf^TIAL FEDERAL AID TO SCr riSV-ICTS EXPERIENCING DIFFICULTY IN 
FUNDING ADEQUATE EDUCATIONAL PRCGRA ; £ ■ 'CONCENTRATIONS OF LOW-I'XOME 
FAMILIES'." The REPORT ALSO STOKE 0^ A ' Z ' NATIONAL m\i CMENT TO UPGRADING 
THE EDUCATION CP "HE POOR. . . 'r:: FT^^ . :t SHOULD BE NOTED THAT THE MAN- 

DATE FOR THIS STL-JY IS ITSELF EVIDL , " CONGRESS HAS CONSIDERED REFOR- 
MULATING ITS- FUifflING OBJECTIVES. TO ^ : r FL^■DS TO LEAs AND SCHOOLS ON 
•THE BASIS OF THE Nli-IBERS OF LOW-AChu.v ; ST.FJENTS. ■ ^-r" 

From HE DECL>\RATi ON OF Policy '^sequent ; formal' Congress i c ' 

STATEMENTS EMERGES THE FIRST rUNDA'- .....L , .^POSE Of'TitLE 1 OF THE E_. 31EN- 

, tary AND Secondary Education Act: 1 ^imancial assistancf to -rMm i ' 

IlI^mi£ll_IIimATI.ON TO T>^ElRjv!ii^jB£S^_Q£ [ m-ITO-1E CHIITIRFN AfjD w:thI|n^ 
IIOE-mSIBI£IS TQ "Tl-IE SCHQOI SJimLX-ii:, TEST NIF^- OF. low-T^r^Y ^lE STUPFNTS. 

Were the provision! of this assi > ■£ the only purpose of Title L . 

EVALUATION WOUUD SIMPLY REQUIRE AN AC;C.J.\T [ :jG OF ITS EFFECTS ON THE DISTRI- 
BUTION OF FUNDS. As THE LEG I SLAT [ OK' • : . . CLEAR. HOWEVER. DISTRICTS RE- 
CEIVING TlTLE'i ASSISTANCE ARE OBLKAiEZ : SPEND IT IN CERTAIN WAYS. AND ' 

1 i 



THESE REQUIRE/'ENTS IMPLY THE EXISTENCE OF ADDITIONAL FUNDAfCNTAL PURPOSES 

FOR Title I ■ 

Providing Fducational Sfrvicfs appears to be we next purpose. 

The Declaration of Policy also states that local educational agencies 

ARE REQUIRED TO USE TiTLE I FUNDS "tO EXPAND AND IMPROVE THEIR EDUCATIONAL 
PROGRAMS BY VARIOUS MEANS . . . V/HICH CONTRIBUTE PARTICULARLY TO MEETING THE 
SPECIAL EDUCATIONAL NEEDS OF EDUCATIONALLY DEPRIVE CHILDREN." ALTHOUGH 

THE Congressional originators of Title I may have differed about the degree to 

WHICH school districts SHOULD BE RESTRICTED IN THEIR USE OF FUNDS^ CONGRESS 
CLEARLY INTENDED THAT FUNDS BE USED FOR PROGRAMS TARGETED ON CHILDREN WITH 
SPECIAL 'nEL^DS. The exact nature of the services was left TO HIE JUDGMENT OF 
LOCAL EDUCATORS, 

Section 1.4], of Title I expands' upon the general instruction cited in ■ 
THE Declaration of Policy and, makes school district eligibility for Title 
I grants contingent upon assurances that funds would be used for programs: 

(1) designed to meet the "special educational needs of children in school 
attenda;nIce areas having high' concentrations" of low- income CHI udren J and 

(2) OF "sufficient size^ scope^ and puality to give reasonable promise of 
substantial progress toward meeting those needs." 

In addition^ ti-!e safie section requires assurances Th^T Title I 

funding SUPPLEMENT RATHER THAN SUPPLJ\NT NON-FeDERAL FUNDING AVAILABLE FOR 

Title I students^ and '''to the extent practical^ increase the level of 

FUNDS that WOlJlD BE MADE AVAILABLE FOR THE EDUCATION OF PUPILS PARTICIPATING" 

if Federal Fums were not avaiu\ble. 

Bases on the consistent and recurring intent of Congress from 

1965' to 1974^ THE SECOND fundamental PURPOSE OF TiTLE I IS: T o FUND 
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mi^ES^B LOW-ACHinVING CHU TRFN TM THE PQORFST SCHOOI S. 

Student Devri .opmfmt. is thl u\st of the purposes I wamt to kention. 
Congress did not specify ttie exact mature of the services to be delivered 

UNDEk TiTyE L NOR DID IT PRECISELY DEFINE EDUCATIONALLY DISADVANTAGED 

CHILDREN, ■ However, it seems clear that Congress was concerned with 

THE CONNECTION BETOEEM POVERTY m LCW ACH I EVEf'iErfT A^jD HOPED THAT THE 

PROVISION OF Title I services in areas with concentrations of poverty 

MIGHT HELP IflPROVE THE SCHOOL PERFORMANCE OF CHILDREN IN POOR AREAS, 

The 1965 House report Accc.^',PA^YI.N6 ESEA spoke of the "close re^tion- 

SHIP BETWEEN CONDITION OF POVERTY.". , AND POOR ACADEf-lIC PERFORMANCE." 
^bREOVER. MBSERS OF .THE HoUSE CQ^ViITTEE•ON EDUCATION Af^ UbOR CO'^'MENTED. 
IN 1974 THAT COMPARED TO THE FUNDS ALLOCATION PURPOSES OF TiTLE L "tHE 
EDUCATIONAL RESULTS THAI ARE ACHIEVED ONCE THIS AID REACHES SCHOOL DISTRICTS 
ARE THE "more IMPORTANT A^JD MORE FREQUENTLY ^ISCUSSED FACET OF THE PROGRAM." 

ne\/ertheless. the co^'mittee stressed that t:~le i is not solely a prograf-l 
to enhiance basic skills in reading and mathb'atics. 

In the Senate, The Committee on Labor and Public Welfare commented .■ 
upon the same subject i^' discussing v^hy the ca'mittee rejected a proposau 

TO CONCENTRATE 75/o OF^TlTLE I FUNDS ON READING ArO: mTHEMATICS.^,/lHE 1974 
SeNAIE report NOTED. 

...LOCAL OFFICIALS ARE CHARGED WIT>I DEVELOPING LOCAL SOLUTIONS TO 
MEET THEIR SPECIFIC NEEDS. .OfTEN THE SOLUTIONS INVOLVE REMEDIAL 
EDUCATION PROGRAMS IN THE BASIC SKILLS. BUT MANY LOCAL OFFICIALS 
HAVE FOUND THAT THEIR CHILDREN S EDUCATIONAL PROGRESS ALSO DEPEND' 
ON PROVISION OF AUXILIARY SERVICES SUCH AS GUIDANCE Af^ COUNSELING 
> PROGRAMS OR CULTU=/:l ENRICKIENT. TiTLE I IS NOT BASICALLY A . 
SOCIAL SERVICES ?■ ZRAf-lJ HOWEVER, SUCH SOCIAL SERVICES ,ARE NECESS/\RY. 
IF EDUCATION IS Tl TAKE PU\CE. ' ■ 

Perhaps the most _;:eful brief sugary of. the uses Title I funds 
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FOUND ACCEPTABLE BY CONGRESS CAN BE FOUND IN THE SAME SeNATE REPORT. 

It said: "In appropriate circlmgt/\nces. Title I funds my even be used 

FOR auxiliary SERVICES, SUCH AS FOOD. ^iEDICAL OrN JENTAL SERVICES. AND 

clotming, but. the f^iph^sis is on education." ■ ' 

Hence, the third' flitoiental purpose is clea,rly established in 

oOuU.ucJSi; .nL INTENT: ~0 CONTRr^ fTE TO THE CO GNITIVF, FNOTIONAL. SOCIAL. 

QEJEHY_$ical development of par-ig I fating studfnts. 

These three funda'cntal purposes of Title i are consistent with one 
another, ejt that is not to say that each is ecually important to every 
iVjber of Congress. Congressional debates, an: even the language of differ-- 

ENT parts of COMf-lITTEE Ai\D CONFERENCE ■ REPORTS. SL-GGEST THAT MEMBERS OF 

Congress differ over the reutive importance c- the several purposes. 
Although some Congressional statB'I'ents I: ,rLY thiat the purposes form 

A HIE."'ARCHY IN WHICH TiTLE I DELIVERS FUND^A^iD SERVICES ONLY TO I1CREASE 
CHILDREN'S ACADEMIC ACHIEVEMEivT — MAKING T S THIRD' PURPOSE .THE 

.MOST IMPORTAI^IT ~ OTHER STATE" '.ENTS MAKE IT CLEAK ~'rAT THE ALLOCATION OF 
FUNDS AND DELIVERY OF SERVICES AKE IMPORTANT ENDS IN THEMSELVES. 

E\mffl(lLlNILEQLM - • ' ' 

J\S I HOPE I HAVE KADE PLAIN. 'EVALUATIOM OF TiTLE I MUST STA^T FROM THE 
RECOGNITION THAT THE PRwGPAM ,HAS SEVERAL PURPOSES. ATJD TO FOCUS EXCLUSIVE- 
LY ON ONE I^■rROPERLY IGNORES THE OTHERS. We h^VE. THEREFORE. INITIATED 
SEVERAL INVESTIGATIONS INTO E/\CH OF THE .AREAS JUST DESCRIBED. 

In ADLITION. EVALUATION MUST ACKNOWLEDGE THAT TiTLE I OPERATES THROUGH 

THE Federal system, and that State and local governments Determine what it 

WILL be in practice BY DELIVERING "HE SERVICES T'-'EIR OWN STUDENTS NEED. 

Although there is only one Fzdefal Tit.^: \ rY:.3RAf^i. i.e.. only ok; 
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BASIC FR/V'IEWCRK OF U\WS AND POLICIES^ IT OPERATES DIFFERENTLY IN EVERY 

State, in 14,000 school districts, at^d in countless cu\ssRoa^,s. 

Thus to understand and evaluath Titlf ^ tt i ,, :ss..-^' to considek 
!E - ir' i^MTCH Federal policy interacts with the actions. of -\tf and i.,ocai. 

educational agencies that ACTUALL\' implement the program. 1",'e, K-^ 
THEREFORE. DEVOTED CONSIDERABLE ATTENTION TO A FC.RTH bV^OR SUB.:CT: THE 
ADMINIS^.-TION of the PROGR/rl. 

Ir smTEGY FOR EW:INING COMPENSATORY EDUCATION CAN' BE VIEWED AS 
AN^ EFFORT TO RESTORE EVALUATION TO ITS PROPER ROLE AS A NEUTRAL ELB-IENT 
IN THE ?C_ICYMAKING. PROCESS, 

TrE ATOIPT IS BASED ON THE RECOGNITION ThWT STUDENT ACHIEVET'iENT 
IS BUT 0 ,E OF THE ELENENTS IN WHICH CONGRESS IS INTERESTED, AND THAT SOCIAL 
SCIENTirs SERIOUSLY MISREPRESENT THE PORPOSES OF FEDERAL PROGRAMS IF 
THEY CONCENTRATE ON ONLY OTJE MEASUPsABLE OUTCOME . ■ 

f'lOREOVER, SINCE THE CONGRESSIONAL CLIENT DISPLAYS LITTLE INCLINATION 
TO DELEGA— JUDGMENTS ABOUT WHETHER TO CONTINUE TiTLE TO SOCIAL SCIENTISTS 
y.NiD REPORTERS, WE MAKE NO ATTEMPT TO SET OURSELVES UP AS FINAL ARBITERS. • 
OF TI-IE PROGRAM, . ' 

In OTHER WORDS, IT IS CLEAR THAT THE FUTURE 0F TiTLE I WIU' BE DETER- 
MINED BY A VARIETY OF EDUCATIONAL, POLITICAL, SOCIAL, AND ECOf^a-lIC 
FACTORS WHICH CONGRESS MUST- CONSIDER, AND NOT BY EVALUATION RESULTS ALO^E. 

-IeNCE, OUR JOB IS TO PROVIDE CONGRESS., l^/HICH IS FAR RE^:OVED FRCf-1 
ACTUAL LOCAL PROGRAMS, WITH AN ACCURATE UNDERSTANDING OF V.HAT THE PROGR.-.'', 

IS IN :pef.ation As weu. of what it m, -it be. 

0 :.0NCLIJDE, THE NIE STUDY OF COMPENSATORY EE^UCATION IS NOT AIMED AT 

provid::.l evidence on whether or not Title I has justified its existence. 
Instead, it will help toBERs of Congress a[.i their staffs at^swer ivo ■ 

rather D:.FrERENT QUESTIONS. , . i 
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• First, if there is to be a Fb ^- dressing edl .^l 

PROBLEMS in POOR AREAS, WHAT IS THE BEST WAY TC DESIGN IT IN TE^jMS OF 

funds distribution. management. amd service delivery? 

Second, hw can local people most effectively use the Federal 
program to guarantee that it i^s the best possible impact on lue grcmth 
and welfare of the chiudren it is intended to serve? 
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